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(57) Abstract: A method for registering first and second digital images of first and second separation patterns, respectively, where 
the digital images are described by gray level functions fi and f2 definal on a pixel set. In accordance with the method, the pixel set 
is divided into m regions Rj,„„Ric,..,RTn.For each region Rt, a sequence of transformations Ski Skrj„,Sk,nk, mapping into the 
pixel set is selected. A similarity score is then calculated for each of the nt regions Sitj(Rk) for j=l,...n]t, where the similarity score 
scores the similarity of the appearance of Rk in the first digital image and the appearance Skj(Rk) in the secoiKl digital image, A 
transformation is then selected frc«n among the Sk,I^^*,SkJ^..Sk^nk for which the similarity score, St(R^ is maximal among the 
similarity scores of the Sk/RjJ for j=l ,„,nt» A pixel in Ri^ is then selected. A global transfonnation T mapping the pixel set into 
the pixel set is defined based upon at least some of the Sjt(pk), and the image of the second image under T~', is obtained to produce 
a modified second image 
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METHOD FOR REGISTERING SEPARATION PATTERNS 



FIELD OF THE INVENTION 

The invention relates to methods of registering a pair of one- or 
two-dimensional separation patterns, for example such patterns as are obtained by 
one- or two-dimensional electrophoresis. 

BACKGROUND OF THE INVENTION 

Separation of a soiubilized mixture of molecules into its components is 
routinely performed by forcing the iTUXture to migrate through a porous solid or 
fluid medium called the ''matrix*\ The matrix and other relevant factors are 

] 0 selected so that the various molecules of the mixture have diflFerent migration rates 
in die matrix according to a particular criterion. The mixture thus separates into its 
components as it progresses through the matrix. Conditions may be chosen so that 
the migration rate of a molecule will depend, for example, upon its molecular 
weight or its electrical charge. 

15 At the end of the separation, the components are visualized by various 

methods either in the matrix or as they are eluted from the matrix, thus producing a 
one-dimensional separation pattern consisting of an array of spots. Each spot in the 
array contains all of those molecules in the mixture that migrated through the 
matrix at a particular rate. The molecules in a given spot may all be identical. More 

20 commonly, however, the spot will still contain a mixture of different molecules. If 
for example the molecules were separated according to molecular weight, then a 
given spot will contain all the molecules in the original mixture having about the 
saine moleculai- weight. 
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Gel electrophoresis is a solid phase separation technique. The matrix, in this 
case, is a gel slab topically of polyacrylainide, and the mixture is made to migrate 
through the gel under the influence of an electric field. In one application^ 
molecules such as proteins or nucleotides separate according to their molecular 
weight. In another application, known as isoelectric focusing, molecules separate 
according to their isoelectric point (the pH at which a given molecule is electrically 
neutral). Other solid phase separation techniques include thin layer 
chromatography, paper chromatography, and liquid chromatography. Other 
separation techniques include mass spectroscopy* 

Since a given spot in a one-dimensional separation pattern may still be a 
mixture of different molecules, it is common to subject the spots in the pattern to a 
second round of separation in which the molecules are made to migrate in a 
direction perpendicular to that of the first round. In the second roimd, conditions 
are chosen so that the molecular components of each spot are separated according 
to a different criterion than was used during the first round. After the second round 
of separation, the molecules are visualized producing a two-dimensional separation 
pattern. Each spot in the pattern will contain those molecules that migrated through 
the matrix at the same rates during both separation rounds* In most instances, each 
spot will contain a single molecular species. 

For example, a mixture of proteins may first be separated by gel 
elecu*ophoresis according to their isoelectric point and the resulting 
one-dimensional separation pattern subjected to a second round of electrophoresis 
according to molecular weight. More than 5,000 proteins can be resolved on a 
single gel by this type of two-dimensional electrophoresis. 

It is often of interest to compare two or more two-dimensional separation 
patterns. For example, a two-dimensional electrophoretogram of blood plasma 
proteins from two individuals may be compared. Corresponding spots in the two 
patterns having different sizes (indicative of a different abundance of a protein in 
the two samples) or spots having different locations in the patterns (indicative of a 
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niutaied proiein) are identified. Such differences may reflect the molecular basis of 
a disease. 

In order iilcmily altered spots in two separation patterns^ the two patterns 
must first be put in rcji^icn This involves identifying pairs of corresponding spots 
5 in the two patterns. Cicneraiing a one-to-one correspondence between spots in the 
two patterns (referred io herein as registration) is complicated by the fact that 
corresponding spi>i.s ni;i\ fia\c different locations and appearances in the two 
patterns not only due to intrinsic di (Terences in the original samples but also due to 
unavoidable variability in sample preparation, matrix preparation, running 

10 conditions, visualization ol the pattern and physical warping of the matrix. 

Algorithms designed to register a pair of separation patterns are known in 
the art, for example Melanie^'^ and PDQuest™ marketed by Bio-Rad Laboratories 
and Bio Image^'^ marketed by Bio Image U*K. In these algorithms spots are 
detected in digital images of the pattems. This yields a ''spot^file" for each pattern 

15 consisting of a list of die detected spots, their centers, boundaries and volume. The 
two images are then presented side by side to the user on a monitor screen and the 
two lists are aligned interactively. The user is prompted to indicate pairs of 
corresponding spots, which is ofiten a laborious and time-consuming process, 

U.S. Patent No. 5,073,963 to Sammons et aL discloses a computerized 

20 method for registering spots in a pair of two-dimensional gel electrophoretograms. 
Their method makes use of coordinate transformation techniques known in the art. 
A spot file for each pattern is obtained and a transformation of a predetennined 
type is sought that generates a one-to-one correspondence between the spots in one 
fi le and those of the other with minimal distortion of the pattems, as measured by a 

25 predetemiined distortion criterion- 

SUMMARY OF THE INVENTION 

Within the context of the present invention, two explicitly described, 
calculable or measurable variables are considered equivalent to each other when the 
30 two valuables are propoitional to each other. 
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Tlie present invention provides a method for registering digital images of 
two separation patterns of the same dimensionality. A pixel is a vector having the 
stune dimensionality as the pattern- The first and second digital images are 
described by means of gray level ftmction f\ and^, respectively^ defined on a pixel 
5 set, that describe the intensity of the image at each pixel. A region of the pixel set 
is a subset of the pixel set. The appearance of a region in a digital image is the 
lesU'iction of its gray level function to the region. 

In accordance with the invention, the registration is described by means of a 
transformation T, referred to as the global registration transformation, mapping at 
H) least a subset of tlie pixel set into the pixel set. This is in contrast to prior art 
methods where registration is performed by applying transformation techniques to 
the spot lists derived from the digital images. The present invention thus utilizes a 
larger amount of available data for the registration process than the prior art 
methods. The utilized data include not only the location and precise stmcture of the 
15 spots of the visuahzed molecules, but also reproducible staining in the patterns 
arising f rom other sources such as streaks and spot shapes. 

hi accordance with the invention, the global registration transformation T is 
obtained as follows. At least a portion of the pixel set is divided into m regions 
Rr,...,Rk,..-Rm. For each region Rk, a finite sequence of Uk transformations 
20 5jt. is selected, where each transformation S^j maps Rk into the pixel 
set. Tiiis generates a sequence of nk regions in the pixel set denoted by Skj(Rk) 
(j=l,..aik). For each of the Uk regions Skj(Rk) a similarity score is calculated which 
scores tl^e similarity of the appearance of Rk in the first digital image and the 
appearance of Sk,j(Rk) in the second digital image. An optimal transformation Sk is 
25 selected from among the Uk transformations iSfcj,,«,5A.i,.,.&,»* for which the 
similarit\^ score of Sk(Rk) is maximal. 

The global transforaiation T is now determined as follows. In each region 
Rk, a pixel pk is selected, pk inay be for example the center of gravity of R^. A 
global transforaiation T is then found based upon at least some of the SkCpk), for 
30 k=L..-m. 
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The first image may be partitioned into any number m of regions. As 
extreme examples, it may be partitioned into a single region, or each pixel in the 
image may be taken as a separate region. The regions may have any shape such as 
squares, rectangles, circles, ellipses or irregular shapes. The regions in a partition 
5 may all be of the same shape^ or there may be regions in the partition of different 
shapes. The regions may or may not overlap. The image may be partitioned into a 
regular array of identical regions. The partition may be formed taking into account 
the distribution of spots in the separation pattern. For example, a partition may be 
formed so that no regions in the partition is devoid of spots while areas in the 

10 pattern witli many will be divided into a lai^e number of small regions. 

In a preferred embodiment, the regions Rk> are chosen so that each one 
contains at least two spots, and most preferably three or four spots of the first 
digital image. If a region Rk contains too many spots, it may not be satisfactorily 
transformed by any of the transformations Skj as assessed by the similarity scores, 

(S On the other hand, regions that are have too few spots may have a geometric 
signature that is not sufficiently unique, in which case several of the 
U'ansformations Skj may have high similarity scores. For example, a region that 
contains only one spot can potentially match any other single-spot region. Spots 
may be detected by methods Icnown in the art. For example, the boundary of a spot 

20 in a digital image may be recognized as a location where the Laplacian of the gray 
level function of the pattern exceeds a threshold value. Thus^ for example, the 
number of spots in the first digital image may be determined and the average area 
of a region containing four spots, calculated. A region of this area is constmcted 
around ever)? spot in the first pattern, and a score calculated for each of the regions 

25 tliat takes into account the number of spots in the region, their contrast and area. 
For each pair of strongly overlapping regions, the one with the lowest score is 
discarded. 

■r 

In accordance with another embodiment, regions in the pixel set are first 
designated and then ordered. For example, a score is calculated for each of the 
30 regions that takes into account tlie number of spots in the region in the first image, 

BNSDOClD;<WO 014S046A1 |i_5. 
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their conli asi and area. A rt gion Ri is selected as the region having a high score 
near the center of the first digital image. The remaining regions are then 
sequentially orLicrcJ according to increasing distance from the first region. 

hi yet ani^ihcr cnihodinienu the transformations are translations of the 

5 form Sk,j(x)=x+ ^/l,,* w here ^kj are translation vectors* The translation vectors may 
be selected, for example, among lattice points of the form /s, for one-dimensional 
digital images, and /si^/js^ for two-dimensional images, where &, S| and si are 
vectors, s\ and S2 arc linearly independent, and / an A are integers satisfying |l|<di 
and |h|<d2 for predetermined constants d| and d2. The vector s or the vectors si and 

ID S2 are most preferably chosen such that their magnitudes are approximately equal to 
the radius of the smallest expected spot in the digital image and will typically be 
around 3 pixels. Other t>^pes of transformations Sjg are also envisaged within the 
scope of the invention including linear transformations and afBne transformations. 
The transformations Sk,j may take into account torn parts or warping of the matrix^^ 

15 for example by using models of deformable membranes as disclosed, for example, 
in Singh etaL, 1998. 

The similarity score is designed to take into account differential expression, 
different staining qualities or techniques, and other irregularities in the two images 
such as artefactual staining, contamination, air bubbles etc. Hie scoring function 

20 compares the appearance of a region Rk in the first image to that of each of the nk 
regions Skj^CRk) in the second image. The scoring functions thus use nearly all of 
the infomiation contained in the two images. This is in strong contrast with prior art 
registration methods that use only the list of approximated spot profiles, or 
Gaussians of the images. 

25 The similarity score of Rk in tlie first image and Skj(Rk) in the second image 

may be described as a function having, for example, the form ^G(x, Skj(x)) where 
the sum is taken over all xeR^. G is a function that preferably increases if the 

contrast at x and Skj(x), in the first and second images, respectively, both exceed a 
predetermined minimal contrast, G may be further increased, for example, when the 
30 contrast at x and Skj(x) are both above a second higher predetermined leveL This 
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favors matching of strong spots over matching of faint spots or spots with 
dissimilar contmsc. The score may also take into account a comparison of the scalar 
product ol' ihc two intensity gradient vectors. This gives an added bonus for spots 
ihai ha\ e about the same size and shape. This contribution arises from the edge 
5 pixels *>r ilic spots, hi cases where the edges overlap and are similarly oriented* the 
sloic is ifKTcascd. Where there is no correlation or negative correlation, it 
dunu j tie.., l liis contribution mimics some of the processing that the human eye 
doc^ when aiicinpiing to match gel images* It is reasonable to prefer a 
trarrstoraiatn>n iJiai matches spots with similar contrast, size and shape, to one that 

JO niaichc^ .spots ihai dilTer widely. 

Ihc selection of the optimal transformations Si,.-.,Sk,...,Sm may be 
pciliHincd itcraiivcly. For example, once the optimal transformations Sj,,.*,Sk-i 
have bccii selected, a similarity score may be used that prefers an Sk that is similar 
to one or more of any of the Si,,..,Sk*i. 

15 The global trans fonnation T may be obtained from the Sk(pk) by several 

diUcTcnt methods as are known in the art. If the number of regions (m) is 1, 2 or 3, 
T ma) be defined as the imique translation, linear transformation, or affine 
tiansforniation. respectively, determined by the constraints T(pk)=Sk(pk), for 
k=^l,...ni. Cvea when m is large, a translation may be satisfactory, for example;, if 

20 the two images were obtained from different scans of the same separation pattern. 
If the images are from different patterns, but the separation technique is known to 
have very tight geometric tolerances (for example, by using a matrix having a rigid 
backing), theji an affine transfonnation may be satisfactory. An affine 
transformation compensates for shift, rotation, scaling, and skew of the axes, but 

25 does not compensate for other types of defonnation such as warping of the matrix. 
In cases such as these, T may be a radial basis function transformation, for 
example, as disclosed in Poggio and Girosi 1989, Poggio and Girosi 1990, or 
Girosi et ai 1995^ or a Delaunay triangulation trans foraiation, as disclosed, for 
example, in Kanaganathan et al 1991, or Baker 1987. Once the global 
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transtbrmation has been founcL the ima^e can be transformed in one of several 
standard laiown ways such as nearest neighbor, biUnear, or bicubic interpolation. 

Once a global transformation fiinction has been obtained in accordance with 
the invention, it may be revised, for example, using optical flow equations, as 
5 disclosed- for example in Aggarwal et al. 1988» or Huang et al^ 1994. In this 
method, a desired correction vector w(x) is found by minimizing the expression 
^( Vg^ * w-dg)~ , wherein Vg is the gradient vector of the intensity at x and dg is 

the gray level difference between x and T(x)* The minimum is easily found using 
least mean square fitting techniques for example as disclosed in Press et ai, 1992. 

10 T(x) is then replaced with T(x)+w(x). This revision improves robustness and 
precision and may be repeated several times. 

The results of the registration may be presented to a user by superimposing 
the two digital images on a monitor screen such that a pixel in one digital image is 
superimposed upon its image under the transformation in the other. The two digital 

J 5 images may be false-colored, If^ for example, the spots in one image are false 
colored blue, and those in the other digital image are false-colored yellow, then any 
superimposed spots in the superimposition will appear green. 

The invention may be used to compare each of several separation patterns to 
one particular separation pattern referred to as the ''"master pattern". The master 

20 pattern may be annotated by compiling information on the composition of each spot 
in the pattern. For example, a two-dimensional electrophoretogram of blood 
plasma proteins from a healthy individual may be prepared and used as a master 
pattern. Test electrophoretograms from other individuals are then registered with 
the master pattern. When the digital image of a test pattern that has been registered 

25 vvith the master pattern is then viewed on a monitor screen, a spot in the test pattern 
may be selected, and the compiled information on the spot presented to the user. 

The invention may be also be used to follow time dependent changes in 
molecular composition. For example, samples of blood plasma of proteins from an 
individual undergoing medical treatment may be obtained at various times and a 

30 two-dimensional separation pattern of each sample prepared. Each separation 
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pattem may be registered with a master pattern or the previous pattern in the 
sequence. The registered patterns may then be displayed sequentially in time on a 
monitor screen so as to animate time dependent changes in the composition of the 
samples. 

5 U will also be understood that the invention contemplates a computer 

program being readable by a computer for executing the method of the invention. 
Ihe invention further contemplates a machine-readable memory tangibly 
embodying a program of instructions executable by the machine for executing the 
method of the invention. 

10 Tlius, in its first aspect the invention provides a method for registering first 

and second digital images of first and second separation patterns, respectively, the 
digital images being described by gray level fimctions f\ and respectively, 
defined on a pixel set, tlie method comprising the steps of; 



15 



ii dividing ' at least a portion of the pixel set into m regions 
Ri,. . .,Ri;,. . .R,«» the m regions each having an appearance in the first image; 
b For each region Rk, 



ba selecting a finite sequence of nk transformations 

Sk^^.,.^Sk^J,..Sk^nL , each transformation mapping Rjc into the 
pixel set; 



20 



bb generating n^ regions Sicj(Rk) for j— l,.,*nk in the pixel set, tlie 
nk regions each having an appearance in the second digital 



image; 



25 



be 



calculating a similarity score for each of the nk regions Skj(Rk) 
for j=l,..,nk, the similarity score scoring the similarity of the 
appearance of Rk in the first digital image and the appearance 
Skj(Rk) in the second digital image; 



30 



bd 



selecting a transformation Sk from among the Uk 
transfonnations Sk, ,5A. 7,„.5it,m for which the similarity score 

of Sk(Rk) is maximal among tlie similarity scores of the 

Skj(Rk) forj=l,..,nk; and 
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^lo- 
be seiectin.; a pixel p^^^ in R^^; 
c defining a glot>al transfomiation T mapping at least a portion of the 
pixel set into the pixel set based upon at least some of the Sk(pk); the 
transfomiation T having an inverse T\ the second image having an 
5 i mage under ^ ; and 

cl obiaining the image of the second image under T"', to produce a 
modified second image. 
In iis scct>rid aspect, the invention provides a program storage device 
readjhlc In MKicliinc tangibly embodying a program of instructions executable by 
10 the machine to pcrlbnn method steps for registering first and second digital images 
of first iitid second separation patterns, respectively, the digital images being 
described by gray level functions f\ and^, respectively, defined on a pixel set, the 
registering comprising the steps of: 

u dividing at least a portion of the pixel set into m regions 

15 R] Rk., . . R„i, the m regions each having an appearance in the first image; 

b For each region Rk, 

ba selecting a finite sequence of nk transformations 
54j,„.,5A.7,...Sifc.«i , each transformation mapping Rk into the 
pixel set; 

20 bb generating nk regions Skj{Rk) for j=l,...nk in the pixel set, the 

nk regions each having an appearance in the second image; 
be calculating a similarity score for each of the nk regions Sicj(Rk) 
for j=l,...nk, the similarity score scoring the similarity of the 
appearance of Rk in the first image and the appearance 
25 Sk,j(Rk) in the second image; and 

bd selecting a transformation Sk from among the nk 
transformations Sk,t,,„,Sk.j,.„Sk.m for which the similarity 

score of Sk(Rk) is maximal among the similarity scores of the 
Skj(Rk)forj=l,<..nk; 
30 be selecting a pixel pk in Rk; 

c defining a global transformation T mapping at least a portion of the 
pixel set into the pixel set based upon at least some of the Sk(pk); the 
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transfomiation T having an inverseT-l, the second digital image 
having an image under T- 1 ; and 
cl obtaining image of the second image under T'*, to produce a 
modified second image. 

In its third aspect^ the invention provides a computer program product 
comprising a computer useable medium having computer readable program code 
embodied therein for registering first and second digital images of first and second 
separation patterns, respectively, the digital images being described by gray level 
functions f\ and fi^ respectively, defined on a pixel set, the registering comprising 
the steps of: 

a dividing at least a portion of the pixel set into ra regions 
Rk-, .,Rk,. - -Rm, the m regions each having an appearance in the first image; 
b For each region Rk> 

ba selecting a finite sequence of Uk transformations 
5*j,.„,5jfe. j,,.,5i./it , each transformation mapping Rk into the 
pixel set; 

bb generating nk regions Skj(Rk) for j=l,...nk in the second 
digital image, Uk regions each having an appearance in the 
second image; 

be calculating a similarity score for each of the nk regions Skj(Rk) 
for j=l,_.nk, the similarity score scoring the similarity of the 
appearance of Rk in the first image and the appearance of 
Skj(Rk) in the second image; 

bd selecting a transformation Sk from among the nk 
transformations iStj,.«,5/c, /,...5jt,m for which the similarity score 
of Sk(Rk) is maximal among the similarity scores of the 
Sk.j(Rk) forj=l,...nk; 
c defining a global transformation T mapping at least a portion of the 

pixels in the pixel set into the pixel set based upon at least some of 

the Sk(pk); tlie transformation T having an inverse T'\ the second 

digital image having an image under T"^; and 
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d obtaining the image of the second image under T'', to produce a 

modified second image* 

In its fourth aspect, the invention provides a program storage device readable by 

machine, tangibly embodying a program of instructions executable by the machine 

5 to perform method steps for registering a sequence of n digital images Iu-..In of n 

separation patterns, respectively, the digital images being described by gray level 

functions defined on a pixel set, the method comprising the steps of: 

a registering the digital images Ii and I2 according to any one of Claims 

1 to 15; to produce an image V2 that is the modified image of I2; 

10 b registering I'k and Ik+i, for all k from 2 to n-1 according to any one of 

Claims 1 to 15 to produce an image Vk+u where I'k and IV+i are the 

modified images of Ik and Ik+i, respectively. 

In its fifth aspect, the invention provides a computer program product 

comprising a computer useable medium having computer readable program code 

15 embodied therein for registering a sequence of n digital images Ij,--Jn of n 

* 

separation patterns, respectively, the digital images being described by gray level 
liinctions defined on a pixel set^ the computer program product comprising: 

a computer readable program code for causing the computer to register 
the digital utiages I] and I2 according to any one of Claims 1 to 15; to 
20 produce an image V2 that is the modified image of I2; 

b computer readable program code for causing the computer to register 
I'k and IkH-i, for all k firom 2 to n-1 according to any one of Claims 1 
to 15 to produce an image I'k+i, where I'k and IVi are the modified 
images of Ik and Ik+j, respectively* 
25 In its sixth aspect, the invention provides a program storage device readable 

by machine, tangibly embodying a program of instmctions executable by the 
machine to perform method steps for registering a sequence of n digital images 
lu- - .In of n separation patterns, respectively, the digital images being described by 
gray level functions defmed on a pixel set, the method comprising registering a 
30 master pattern and the image Ik according to any one of Claims 1 to 15 so as to 
produce an image I'k. where I'k is the modified image of Ik, for all k from 1 to n. 
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In its seventh aspect, the invention provides a prograiin storage device 
readable by machine, tangibly embodying a program of instructions executable by 
the machine to perform method steps for displaying a sequence of n digital images 
f !,...]„ of n separation patterns, respectively, the digital images being described by 
5 gray level Itinctions defined on a pixel set, the method comprising: 

a registering the sequence of images according to Claim 32, so as to 
produce a second sequence of images I'l, Is . I'm where V\ is the 
image Ii and I'k is the modified image of Ik, for k from 2 to n; and 
b displaying the second sequence of images ri,».Pn sequentially on a 
10 display. 

In its eighth aspect, the invention provides a computer program product 
comprising a computer useable medium having computer readable program code 
embodied therein for displaying a sequence of n digital images In,. •-In of n 
separation patterns, respectively, the digital images being described by gray level 
15 fiuictions defined on a pixel set, the computer program product comprising: 

a computer readable program code for causing the computer to register 

■ 

the sequence of images according to Claim 32, so as to produce a 
second sequence of images Ti, r2-.-rib where I'l is the image Ii and 
I'k is the modified image of Ik, for k from 2 to n; and 
20 b computer readable program code for causing the computer to display 

the second sequence of images I'l,,. .I'n sequentially on a display. 
In its ninth aspect, the invention provides, a program storage device readable 
by machine, tangibly embodying a program of instructions executable by the 
machine to perform method steps for displaying a sequence of n digital images 
25 In,-.. In of n separation patterns, respectively, the digital images being described by 
gray level tunctions defined on a pixel set, the method comprising: 

a registering the sequence of images according to Claim 33 so as to 
produce a second sequence of images I'l, l'2y^**Vxij where I'k is the 
modified image of Ik; and 
30 b displaying the second sequence of images I'l,.. J'n sequentially on a 

display. 



BNSDOCID: <WO 



0145046A1_I _> 



wo 01/45046 



PCT/ILOO/0077S 



^14- 

In its tenth aspect, tae invention provides a computer program product 
comprising a computer useable medium having computer readable program code 
embodied therein for displaying a sequence of n digital images In,,. -In of n 
separation patterns, respectively, the digital images being described by gray level 
fimctions defined on a pixel set, the computer program product comprising: 

n computer readable program code for causing the computer to register 
the sequence of images according to Claim 33 so as to produce a second 
sequence of images I'l, I'^, - ■ -I'n. where I'k is the modified image of Ik; and 
b computer readable program code for causing the computer to display 
the second sequence of images Tj,. . .I'n sequentially on a display, 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order to understand the invention and to see how it may be carried out in 
practice^ preferred embodiments will now be described, by way of non-limiting 
examples only^ with reference to the accompanying drawings, in which: 

Figs, la and lb show a digital image of a first and second two-dimensional 
separation pattern^ respectively. Fig, Id shows a superimposition of the patterns 
shown in Figs, la and lb, and Fig, Ic shows the registration of the two images 
according to one embodiment of the invention; 

Figs. 2a and 2b show a digital imeige of a first and second two-dimensional 
separation pattern, respectively. Fig, 2d shows a superimposition of the patterns 
shown in Figs. 2a and 2b, and Fig. 2c shows the registration of the two images 
according to a second embodiment of the invention; and 

Figs. 3a and 3b show a digital image of a first and second two-dimensional 
separation pattern, respectively. Fig. 3d shows a superimposition of the patterns 
shown in Figs. 3a and 3b, and Fig. 3c shows the registration of the two images 
according to a third embodiment of the invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
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First Embodiment: Global Afiine Transformation Modei 

The first embodiment will be demonstrated in relation to a pair of 
two-dimensional images. The pixel set is partitioned into a single region (the 
entire pixel set) and the identity transformation is used as the local transformation 
5 S\, The global transformation T is an affine transformation of the fonn 



T is determined as follows. Let x ,...x" be the n pixels in the pixel set, 
10 where a * = (A:f ,x\ ) . Define To as the identity transformation on the pixel set, and 

define the gray level function ga by g^o(x'') =^i(x ), for every pixel x'' in the pixel 
set, where f\ is the gray level function of the first image. Once Ti and g\ have 

« 

been found, Ti+i and gi+i are found as follows. Denote by 
V(x^)=(Vi(x^),V2(x*^))-(VCgy(x*'))4-v(^(x^)))/2 the average gradient vector of the 
(5 two gray level functions^/ andj^, wherey2 is the gray level function of the second 
image. Ti+i is an affme transformation whose six parameters a\^^ ai,2, <22,i, ^32,2, bu 
and hi are found by solving the following overdetermined system of linear 
equations: 



20 



r 



^2! 
1^3 J 
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^>^i+) is then defined by g^i+i(x^)=gi(Ti(x^)). A transfomiation Ai is defined as 
the composition of T* to Ti, Ai=T|? Ti-i?--?ri- The process is terminated when an 
Ai is obtained for which the fraction of pixels x*" in the pixel set for which the 
distance between x*^ and Ai(x^) exceeds a predetermined distance (for example 10 
5 pixels) is small (for example, less than 10% of all of the pixels in the pixel set). The 
global transformation T is then defined as T=Ai- 

If at any stage, the transfomiation Ti is large in the sense that regions of 
the first image are moved large distances in the second itnage, then the images 
may be preliminarily blurred and decimated. This may be performed by methods 
0 kjiown in the art for example as described in E. Adelson, et aL 1984, The 
preferred way of blurring and decimating the image is to average every 3X3 
subarray of pixels of the images into one pixel of the decimated/blurred image. 
The image can then be blurred further, by a binomial operator of the form 

{\ 2 V 

2 4 2 /] 6 , Ti may then be modified by replacing bi and hi with 3b i and 3b2- 

,12 1,^ 

15 Figs, la and 2a schematically show first and second digital images, 

respectively, of two-dimensional electrophoretograms of urine proteins. The 
proteins were first separated in the horizontal direction according to their 
isoelectic point and subsequently in the vertical direction according to their 
molecular weight. In Figs, la and lb, each spot is represented schematically by a 

20 black curve delineating its boundary. The interior of each spot is indicated by 
hatching that is vertical in Fig. la and horizontal in Fig, lb. Fig. Id shows a 
superimposition of the images. A global transformation T between the two 
separation patterns was obtained in accordance with this embodiment and is 
shown in Fig* Ic, In Fig. Ic, the appearance of a pixel x in the first digital image 

25 has been superimposed on the appearance of its image T(x) in the second image. 
Regions of overlap of spots in the two images appear in Figs. Ic and Id by 
vertical hatching superimposed on horizontal hatching. The amount of overlap is 
substantially greater in Fig. Ic compared to Fig. Id. 
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Second Embodiment: Two Dimensional SpUne Transformation. 

The second embodiment will be demonstrated in relation to a pair of 
two-dimensional images. The pixel set is partitioned into a grid of rectangles Rk, 
5 all having the same dimensions whose centers lie on a lattice spanned by two 
linearly independent vectors Si and S2< The local transformations Sk are 
translations and the global transformation T is a spline. 

The width w and height h of the rectangles, can be predetermined 
constants or determined heuristically in each case. For example, a spot of 
10 diameter d (in pixels) in the first image may be selected and the parameters 
obtained hy w = h - \Sf\=\s2\=J0d, 

Background contrast images (BCI) B| and B2 are calculated for the first 
and second images, respectively. The BCI is a fimction of the pixels in an image 
the value of wliich is 0 for pixels not belonging to a spot. For pixels in a spot, the 
15 value of the BCI is a reflection of the contrast of the spot. For two pixels x and 
the pixel score function P5^(jc,>^) is defined as follows: if B](x) or B2(y) is zero, 
then Psf{x,y) = 0 , Otherwise, x is in a spot in the first image and y is in a spot in 
tlie second image, and 

Psfix, y) = l'ha min(5i(x), Bziy)) + jS{V(Mx)), ^Aiy)))^ , 

20 

where (V(/i(a», V(/2(>'))) indicates the absolute value of the scalar 

product of the two gradient vectors V(/i(jc)) and V(/2(>')). This formula 

allows a fixed contribution ( 1 ) to the score if x and y both belong to a spot. This 
allows spots representing differently expressed proteins to match- There is also a 
25 "bonus" for cases where both spots have high contrast, by increasing the score in 
correlation with the minimum of the two contrast values* This encourages 
matching of strong spots over matching of faint spots or spots with dissimilar 
contrast. There is also a contribution from the scalar product of the two gradient 
vectors. This gives an added bonus for spots that have the same size and shape. 
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Wlicre ihert." is Jio correlation or negative correlation, the score is low. This 
mimics some of ihc processing that the human eye does when attempting to 
match images. I Ik consianis a,/? are weighting factors that determine the 
relative coniribuiiou o\ ihc three summands in the definition of Psf. a will 
5 typically be set lu ilic value of the minimal contrast required for a spot. Typical 
values of a and \\ arc ^ /? = 0.1 . 

The local iransl cirmations Skj are translations of the fonn Skj(x)=x-t'flkj, for 
j=^l,.,,nk. The ^/k^ arc scJccied so that the centers of the regions Skj(Rk) in the 
second image fonn a laiiice with a typical distance of s pixels between neighbors, 

io where s is the radius o! the smallest expected spot on the gel. This decreases the 
computational load by (typically, s=3). The <ikj are also selected so that the 
regions Sk.j{Rk) cover an area large enough that Sic(Rk) lies far from the boundary 
of the union of all of the regions Skj(Rk)* The score function for Skj is the sum of 
the psjix^ Skj(x)) for all x in Rk- An Skj having maximal score is then selected and 

J 5 designated as Sk. As in the first embodiment, this selection of Sk may be refined, 
for example, by optical flow techniques as disclosed, for example, in Aggarwal et 
al.^ 1988, Huang et aL 1994. Alternatively, the Sk may be refined taking into 
account the scores of rectangles in the neighborhood of the selected one and 
determining optimal shift. Once an Sk is obtained, it may be checked. For 

20 example, if it is on the boundary of the original search area, or its score is below a 
predetermined threshold, or it deviates substantially firom its nearest neighbors, it 
may be discarded. 

The global transformation in this embodiment is a two dimensional spline 
calculated from the transformations Sk by methods known in the art, for example 
25 as disclosed in de Boor, 1978. Since the ^kj are computed along a grid, the spline 
can be computed first on the horizontal lines^ and than on the vertical lines. 

Figs. 2a and 2b schematically show first and second digital images, 
respectively, of two-dimensional electrophoretograms of urine proteins. The 
proteins were first separated in the horizontal direction according to their 
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isoclcctiL poini and subsequently in the vertical direction according to their 
molecular weiglii. In Figs. 2a and 2b, each spot is represented schematically by a 
black ciirx'c dclineaLing its boundary. Tiie interior of each spot is indicated by 
iKUciiinjj ihat is vertical in Fig- 2a and horizontal in Fig. 2b. Fig 2d shows a 
5 supcrinipi>siiion ot ihc images. The first separation pattern has been divided into 
rcci.urjics wiuvsc centers lie on a lattice, A global transformation T between the 
luo iiii.i-cs i»biained in accordance with this embodiment and is shown in 
f ii:. -\ III I ii: 2c, a pixel x in the first digital image has been superimposed on 
iis iiiKiL'c lix) tn ilic second image. Fig. 2c also shows the system of rectangles 
10 thai was UNcd in iliis example. Regions of overlap of spots in the two images 
appear in Fiizs. 2c and 2d by vertical hatching superunposed on horizontal 
haichini:, I hc ajuount of overlap is substantially greater in Fig. 2c compared to 
I i-. 2d. 

15 Thit cl tlmbodinient: Delaunay Triangulation Transformation Model 

I hc third embodiment will now be described in relation to a pair of 
iwo-dimcnsiona! imases. As in the second embodiment, in this embodiment the 

■ 

pixel set is partitioned into rectangles Rk. However^, the rectangles are selected in 
accordance with the data and do not necessarily form a grid. The local 

20 trans Ibrmations Sk.i are translations and the global transformation T is a spline. 

fhe rectangle sequence determination proceeds as follows: A spot list is 
first prepared of the first image by methods known in the art, for example as 
described in Gonzalez et al., 1977 or Pratt, 1991. The average area S of a 
rectangle (in pixels) containing four spots is^y = 4A/n , where A is the number of 

25 pixels in the pixel set, and n is tlie total number of spots in the image. A rectangle 
is constructed with area A around every spot. In each rectangle, all spots are 
found with contrast above a siven threshold. A score s is calculated for the 
rectangle by s c , where n is the number of spots in the rectangle, c is the 

average contrast of the spots, and a[n] is a weighting function tliat prefers 
30 rectangles containing a number of spots close to predetermined number. In a 
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preferred embodiment, rectangles are preferred in which the number of spots is 
around 3. In this case, a can be defined, for example, by 0,10,15,20, 15, 12, 10, 
& 7. <5, 5, 4. 3, Z L for n equal to 0 to 14, and <i[n]=K) for n greater than 14, For 
each pair of strongly overlapping rectangles, the one with the higher score is 

5 retained and the one with the lower score is deleted. 

The rectangles are now ordered, A rectangle R| with a high score is found 
near the center of the image. The remaining rectangles are subsequently ordered 
by increasing distance from Ri. 

The global transformation in this embodiment is an affine transformation and 

10 a Delaunay interpolation triangulation transformation. The affine transformation 
is obtained as in the first embodiment, and then the Delaunay interpolation is 
used for the differences between the Sk and the affine transformation. This 
provides a stable and robust transformation that is easy extrapolated, as well as a 
method for dealing with relatively small and non-uniform perturbations, 

J 5 The global transformation in each of the Rk is obtained in a process similar 

to that of the first embodiment. However, in this embodiment, the global 
trtmsformation is recomputed after each Sk has been found. Since initially there 
may be insufficient parameters to compute the affine transformation, simpler 
transformations are computed in the first three steps (identity, translation, linear 

20 transformation)- At each stage, Sk is used in obtaining the shift vector a^+i of Sk+j 

A Delaunay triangulation is obtained by methods known in the art» for 
example, as described in Kanaganatfaan et al, 199L The Etelaunay triangulation 
is used to interpolate the global transformation T in the convex hull of the 
triangulation vertices. At the four comers of the image, the Delaunay 

25 triangulation is set to zero so that the comers of the image, the global 
transformation T is affine only* 

Figs. 3a and 3b schematically show first and second digital images, 

■I h 

respectively, of two-dimensional eiectrophoretograms of urine proteins. The 
proteins were first separated in the horizontal direction according to their 
30 isoelectic point and subsequently in the vertical direction according to their 
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molecular weight. In Figs. 3a and 3b, each spot is represented schematically by a 
black curve delineating its boundary. Fig. 3d shows a superimposition of the 
images. The interior of each spot is indicated by hatching that is vertical in Fig, 
3a and horizontal in Fig. 3b. The pixel set was divided into rectangles of 
different sizes so that each rectangle has about the same number of spots. A 
global transformation T was obtained in accordance with this embodiment and is 
shown in Fig. 3c. In Fig. 3 c, the appearance of a pixel x in the first digital image 
has been superimposed on the appearance of its image T(x) in the second image. 
Fill. 3 also shows tlie system of rectangles that was used in this example. Regions 
of overlap of spots in the two images appear in Figs/ 3c and 3d by vertical 
hatching superimposed on horizontal hatching. The amount of overlaps is 
substantially greater in Fig. 3c compared to 3d. 

In the method claims that follow, alphabetic characters used to designate 
claim steps are provided for convenience only and do not imply any particular 
order of performing the steps. 
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CLAIMS: 



1 . A method for registering first and second digital images of first and second 
separation patterns, respectively, the digital images being described by gray level 
functions /i andfi, respectively, defined on a pbcel set, the method comprising the 
steps of: 

a dividing at least a portion of the pixel set into m regions 
Ru . , .,Rk, . - .Rnu the m regions each having an appearance in the first image; 
b For each region Rk, 

ba selecting a finite sequence of nk transformations 

Sk, ,5i,/,...St.;a , each transformation mapping Rk into the 

pixel set; 

bb generating nk regions Skj(Rk) for j=l,. ..nk in the pixel set, the 
nk regions each having an appearance in the second digital 
image; 

be calculating a similarity score for each of the nt regions Sk j(Rk) 
for j=U...nk, the similarity score scoring the similarity of the 
appearance of Rk in the first digital image and the appearance 
Sk,i(Rk) in the second digital image; 

bd selecting a transformation Sk from among the nk 
transfomiations 5ij,„-,5i. for which the similarity score 

of Sk(Rk) is maximal among the similarity scores of the 
Skj(Rk) for j==l,,..nk; and 

be selecting a pixel pk in Rr; 
c defining a global transforaiation T mapping at least a portion of the 

pixel set into the pixel set based upon at least some of the Sk{pk), the 

transformation T having an inverse the second digital image 

having an image under T"*; and 
d obtaining the image of the second image under T'', to produce a 

modified second image. 
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2. The method of Claim 1 wherein the first and second separation patterns are 
one-dimensional separation patterns. 

3, The method of Claim 1 wherein the first and second separation patterns are 
two-dimensional separation patterns, 

5 4. The method of any one of the previous claims wherein the first and second 
separation patterns are obtained using a separation technique selected from the list 
comprising: 

(a) Electrophoresis; 

(b) paper chromatography; 

10 ( c ) thin- lay er chromatography ; 

(d) high pressure liquid chromatography; and 

(e) mass spectroscopy. 

5. The method of any one of the previous claims wherein the number of 
regions, m, is equal to one. 
15 6. The method of any one of the previous claims wherein one or more of the 
regions Rk contain exactly one pixel, 

7. The method of any one of the previous claims wherein one or more of the 

regions Rk are rectangles. 

8. The method of any one of the previous claims wherein the regions Rk are 
20 rectangles that are regularly arranged in the first image. 

9. The method of any one of the previous claims wherein the step of dividing 
at least a portion of the pixel set into m regions Rk for k=l to k==m comprises the 
steps of designating a scoring function, the scoring fimction scoring regions in the 
pixel set and selecting regions Rk for k=l to m, where each region has a score 

25 greater than a predetennined value, 

10. The rnethod of Claim 9 wherein the scoring function comprises the 
algorithmic expression s=a[n]*Cj wherein n is the number of spots in a region, c is 
the average contrast of the spots and a\n] is a function of the number of spots in the 
resiion. 

30 11. Tlie method of Claim 10 wherein ^[n] has a maximum at n about equal to 
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12. The method of any one of the previous claims wherein one or more of the 
transformations Sk.j are of a type selected from the list comprising: 

(a) translations; 

(b) linear transformations; and 
5 (c) affine transformations. 

13. The method of any one of the previous claims wherein the similarity score 
scoring the similarity of the appearance of Rt in the first image and the appearance 
of Sk,i(Rk) in the second image is given by the arithmetic expression E psflx, 
Skj(x)), wherein the sum is taken over all x in R^, and 

i 0 Psf (a, y) = l+a min(Bi(x), Bziy) + J3{V(/ V(f liy))) ' for any two pixels x and 

y, wherein B i and B2 are background contrast images of the first and second digital 
images, respectively, and a and p are two predetermined constants. 

14. Tlie method of any one of the previous claims wherein the global 
transformation is a spline, 

15 15. The method of any one of Claims 1 to 14 wherein the global 
transformation in a Deiaunay triangulation transformation. 

16. A program storage device readable by machine tangibly embodying a 
program of instructions executable by the machine to perform method steps for 
registering first and second digital images of first and second separation patterns, 
20 respectively, tiie digital images being described by gray level fimctionsyi and^, 
respectively, defined on a pixel set, the registering comprising the steps of: 

f^ dividing at least a portion of the pixel set into m regions 
Ri, , . .,Rk,- - -Rim tlie ra regions each having an appearance in the first image; 
b For each region Rk, 
25 ba selecting a finite sequence of nk transformations 

5Aj,...,5A,y,...5it,iijfc , each transformation mapping Rk into Ihe 
pixel set; 

bb generating nk regions Sk.j(Rk) for j=l,.-.nk in the pixel set, the 
Uk regions each having an appearance in the second image; 
30 be calculating a similarity score for each of the Hk regions Skj(Rk) 

for j=l,...nk, the similarity score scoring the similarity of the 
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appearance of Rk in the first image and the appearance 
Sk.j(Rk) in th<^ second image; 
bd selecting a transfoimation from among the nk 

transformations for which the similarity 

score of Sjt(Rk) is maxima! among the similarity scores of the 
Skj(Rk)forj=l,.,.nk; 
be selecting a pixel pk in Rk; 
c defining a global transforaiation T mapping at least a portion of the 
pixel set into the pixel set based upon at least some of the Sk(pfc), the 
transformatioan T having an inverse T'\ the second image having an 
image under T'*; and 
d obtaining the image of the second image under T'*, to produce a 
modified second image* 
17. The program storage device of Claim 16 wherein the first and second 
separation patterns are one-dimensional separation patterns. 

18* The program storage device of Claim 16 wherein the first and second 
separation patterns are two-dimensional separation patterns. 

19. The program storage device of any one of the previous claims wherein the 
first and second separation patterns are obtained using a separation technique 
selected from the list comprising: 

(a) electrophoresis; 

(b) paper chromatography; 

(c) thin-layer chromatography; 

(d) high pressure liquid chromatography; and 

(e) mass spectroscopy. 

20. The program storage device of any one of the previous claims wherein the 
number of regions, m, is equal to one, 

21. The program storage medium of any one of the previous claims wherein 
one or more of the regions Rk contain exactly one pixeL 

22. The storage medium of any one of the previous claims wherein one or 
more of the regions Rk are rectangles. 
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23* Tlie program storage device of any one of tlie previous claims wherein the 
regions Rk are rectangles that are regularly arranged in the first image. 

24. The program storage device of any one of the previous claims vi^herein the 
step of dividing at least a portion of the pixel set into m regions Rk for k=l to k=m 

5 comprises the steps of designating a scoring function scoring regions in the pixel 
set and selecting regions for k=l to ra, where each region has a score greater 
than a predetermined value. 

25. The program storage device of Claim 24 wherein the scoring function 
comprises the algorithmic expression s=£2[n] c5 wherein n is the number of spots in 

10 a region, c is the average contrast of the spots and fl[n] is a function of the number 
of spots in the region. 

26. The program storage device of Claim 25 wherein a[n] has a maximum at n 
approximately equal to 3. 

27. The program storage device of any one of the previous claims wherein one 

« 

15 or more of the transfonnations Skj are of a type selected from the list comprising: 

(a) translations; 

(b) linear transfomiations; and 

(c) affine transformations. 

28. The program storage device of any one of the previous claims wherein the 
20 similarity score scoring the similarity of the appearance of Rk in the first image and 

the appearance of Skj(Rk) in the second image is given by the arithmetic expression 

Z p^x, Skj(x)), wherein the sum is taken over all x in Rk, and 

Ps/Xx^y) = 1 + amin(5i(A:),52(j/) + ;ff(V(/ V(/ 2(>^)))^'^^ for any two pixels x and 



y in the pixel set, wherein Bt and B2 are background contrast images of the first 
and second digital images, respectively, and a and p are predetermined constants. 

29. Tlie program storagL device of any one of the previous claims wherein the 
global transformation is a spline. 

30. The program storage device of any one of Claims 16 to 29 wherein the 
global transformation is a Delaunay triangulation transformation. 

31. A computer program product comprising a c.omputer iiseabie medium 
having computer readable program code embodied therein for registering first and 
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second digital images of first and second separation patterns, respectively, the 
digital images being described by gray level functions f\ and respectively, 
defined on a pixel set, the registering comprising the steps of: 

a dividing at least a portion of the pixel set into m regions 
5 R I , - . . ,Rk, ' . ■ Rin, the m regions each having an appearance in the first image; 

b For each region Rk, 

ba selecting a finite sequence of transformations 
iSi,i,«.,5'it, A...&wi* , each transformation mapping Rk into the 
pixel set; 

10 bb generating nk regions Skj(Rk) for j=l,-,.nk in the second 

digital image, nk regions each having an appearance in the 
second image; 

be calculating a similarity score for each of the nk regions Skj(Rk) 
for j=l,,..nk, the similarity score scoring the similarity of the 
15 appearance of Rk in the first image and the appearance of 

Skj{Rk) in the second image; 
bd selecting a transformation Sk fi*om among the nk 
transformations Sk.\,...^Sk,j^..Sk.nk for which the similarity score 
of Sk(Rk) is maximal among the similarity scores of the 
20 Skj(Rk) for j= U • , .Uk; 

c defining a global trans fomiation T mapping at least a portion of the 
pixels in the pixel set into the pixel set based upon at least some of 
the Sk(pk), the transfonnation T having an inverse, the second digital 
image having an image under T''; and 
25 d obtaining the image of the second image under T"\ to produce a 

modified second image. 
32. A method for registering a sequence of n digital images Ii,,,.In of n 
separation pattems, respectively, the digital images being described by gray level 
functions defined on a pixel set, the method comprising the steps of: 
30 a registering the digital images Ii and I2 according to any one of Claims 

1 to 15; to produce an image Vi that is the modified image of I2; 
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b registering I'k and Ik+i, for all k from 2 to n-1 according to any one of 
Clainis I to 15 to produce an image I'k+i? where Pk and I'k+i are the 
nuxlillcd inwgcs of Ik and Ik+i, respectively. 

33. A method U^v rcgisicring a sequence of n digital images lu-.Jn of n 
5 separation patterns, respectively^ the digital images being described by gray level 

functions defined on a pixel set, the method comprising registering a master pattem 
and the image U according to any one of Claims 1 to 15 so as to produce an 

image I'k, where I'k is ihc modified image of Ik, for all k from 1 to n* 

34. A method for displaying a sequence of n digital images In,.- -In of n 
10 separation patterns, respectively, the digital images being described by gray level 

ftinctions defined on a pixel set, the method comprising: 

a registering the sequence of images according to Claim 32, so as to 
produce a second sequence of images P|, r2-*-l'n» where V\ is the image Ii 
and Tk is the modified image of Ik, for k from 2 to n; and 
15 b displaying the second sequence of images I'i,--.rn sequentially on a 

display, 

35. A method for displaying a sequence of n digital images lu^.Jn of n 
separation patterns, respectively, the digital images being described by gray level 
functions defined on a pixel set, the method comprising: 

20 £1 registering the sequence of images according to Claim 33 so £is to 

produce a second sequence of images I'l, r2,- . *Vn, where I'k is the modified 
image of Ik; and 

b displaying the second sequence of images ri,...rn sequentially on a 
display. 

25 36. A program storage device readable by machine, tangibly embodying a 
program of instmctions executable by the machine to perform method steps for 
registering a sequence of n digital images Ii,..-In of n separation patterns, 
respectively, the digital images being described by gray level functions defined on a 
pixel set, the method comprising the steps of: 

30 a registering the digital images I| and h according to any one of Claims 

1 to 15; to produce an image I'l that is the modified image of I2; 
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b registering Pk end Ik+i, for all k from 2 to n-1 according to any one of 
Claims 1 to 15 to produce an image r^+i, where l\ and are the 
modified images of Ik and Ik+i, respectively, 
37- A computer program product comprising a computer useable medium 
5 having computer readable program code embodied therein for registering a 
sequence of n digital images Ii,. . .In of n separation patterns, respectively^ the digital 
images being described by gray level functions defined on a pixel set, the computer 
program product comprising: 

u computer readable program code for causing the computer to register 
10 the digital unages Ii and I2 according to any one of Claims 1 to 15; to 

produce an image V2 that is the modified image of I2; 
b computer readable program code for causing the computer to register 
Tk and Ik+i, for all k from 2 to n-1 according to any one of Claims 1 
to 15 to produce an image I'k+i, where Pk and Tk+i are the modified 
1 5 images of Ik and Ik+ 1 , respectively, 

38. A program storage device readable by machine, tangibly embodying a program 
of instructions executable by the machine to perform method steps for registering a 
sequence of n digital images Ii,. . .I,, of n separation patterns, respectively, the digital 
images being described by gray level functions defined on a pixel set, the method 

20 comprising registering a master pattern and the image Ik according to any one of 
Claims 1 to 15 so as to produce an image I'k, where l\ is the modified image of Ik^ 
for all k from 1 to n. 

39. A program storage device readable by machine, tangibly embodying a 
program of instructions executable by the machine to perform method steps for 

25 displaying a sequence of n digital images l!,.-Jn of n separation pattems, 
respectively, the digital images being described by gray level fimctions defined on a 
pixel set. the method comprising: 

a registering the sequence of images according to Claim 32, so as to 
produce a second sequence of images I'l, p2-..rn, where I'l is the 
30 image li and Tk is the modified image of Ik, for k from 2 to n; and 

b displaying the second sequence of images ri,.-.rn sequentially on a 
display. 
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40* A computer program product comprising a computer useable medium 
having computer readable program code embodied therein for displaying a 
sequence ot n digital images In, - -In of n separation patterns, respectively, the digital 
images being described by gray level functions defined on a pixel set, the computer 
5 program product comprising: 

n computer readable program code for causing the computer to register 
the sequence of images according to Claim 32, so as to produce a 
second sequence of images Vu I'l-.-IV where I'l is the image Ii and 
l\ is the modified image of Ik, for k from 2 to n; and 
10 b computer readable program code for causing the computer to display 

the second sequence of imagesri,..J'n sequentially on a display. 

41, A program storage device readable by machine, tangibly embodying a 
program of instructions executable by die machine to perform method steps for 
displaying a sequence of n digital images I„,,.Jn of n separation patterns, 

1 5 respectively, the digital images being described by gray level functions defined on a 
pixel set, the method comprising: 

a registering the sequence of images according to Claim 33 so as to 
produce a. second sequence of images Pi, r2,-.rn, vvhere l\ is the 
modified image of Ik; and 
20 b displaying the second sequence of images ri,.,,rn sequentially on a 

display. 

42. A computer program product comprising a computer useable medium 
having computer readable program code embodied therein for displaying a 
sequence of n digital images In, - . .In of n separation patterns, respectively, the digital 

25 images being described by gray level functions defined on a pixel set, the computer 

+ 

program product comprising: 

a computer readable program code for causing the computer to 

registering the sequence of images according to Claim 33 so as to produce a 
second sequence of images Tj, r2,...I'n, where Tk is the modified image of 
30 Ik; and 
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computer readable program code for causing the computer to 
displaying the second sequence of images Pj,,.J'n sequentially on a 
display. 
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